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Abstract 

We consider an urn model, whose replacement matrix has all entries nonnegative and is balanced, that is, has 
constant row sums. We obtain the rates of the counts of balls corresponding to each color for the strong laws 
to hold. The analysis requires a rearrangement of the colors in two steps. We first reduce the replacement 
matrix to a block upper triangular one, where the diagonal blocks are either irreducible or the scalar zero. 
The scalings for the color counts are then given inductively depending on the Perron-Frobcnius eigenvalues 
of the irreducible diagonal blocks. In the second step of the rearrangement, the colors are further rearranged 
to reduce the block upper triangular replacement matrix to a canonical form. Under a further mild technical 
condition, we obtain the scalings and also identify the limits. We show that the limiting random variables 
corresponding to the counts of colors within a block are constant multiples of each other. We provide an 
easy-to-understand explicit formula for them as well. The model considered here contains the urn models 
with irreducible replacement matrix, as well as, the upper triangular one and several specific block upper 
triangular ones considered earlier in the literature and gives an exhaustive picture of the color counts in the 
general case with only possible restrictions that the replacement matrix is balanced and has nonnegative 
entries. 
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1. Introduction 



Consider an urn with balls of D colors. The colors will be labeled by natural numbers as 1,2, ... ,D. We 
start with an initial configuration of balls of different colors, where count of each color is strictly positive 
and add up to one. Note that the term "count" is an abuse of notation and it need not be an integer, but 
can be any positive real number. The fact here and later that "count" may not be integers does not cause 
much problem, as these numbers are used to define certain selection probabilities only in the sequel. The 
word "count" allows us to use the more picturesque language of "drawing a ball". Let the row vector Co, 
which we assume to be a probability vector with all components positive, denote the initial count of balls of 
each color. The composition of the urn evolves by adding balls of different colors at times n = 1, 2, 3, ... as 
follows. The evolution of the composition of the urn will be governed by a replacement matrix R. 

Throughout this article, we shall assume that the replacement matrix R = ((r^)) is a D x D non-random 
balanced (that is, each row sum is same and hence, without loss of generality, one) matrix with nonnegative 
entries. Again note that the entries need not be integers, but real numbers. Let Cm denote the row 
vector of the counts of balls of each color after the iV-th trial, N = 1,2,.... We describe the evolution of 
C n inductively. At the iV-th trial, a ball is drawn (or a color is selected) at random from the urn with the 
current composition Cn-i, so that the i-th color appears with probability CV-i,i/^V, i — 1, . . . , D. If the 
i-th color appears, then, for j = 1, . . . , D, rij balls of j-th color are added to the urn before the next draw, 



together with the drawn ball, that is CT/v, 



C 



N-l,j 



+ r ij} for j 



D, when i-th color appears in the 



A-th draw. It is of interest to study the stochastic behavior of CV as A — >• oo. 

If the replacement matrix is balanced with the common row sum 1 and has nonnegative entries, then 
it can be viewed as a transition matrix of a Markov chain on a finite state space of size D and it will be 
meaningful to talk about the reducibility or irreducibility of the matrix. However, the notion of irred ucibility 
can ea sily be extended to any matrix with all entries nonnegative, see, for example, Chapter 1.3 of ISeneta 
l|200fih . 



Definition 1.1. A D x D matrix R with all entries nonnegative is called irreducible if for each 1 < i,j < D, 
there exists n = n(i,j) such that the (i,j)-th entry of R n is strictly positive. A matrix, which is not 
irreducible, will be called reducible. 

Note that, for an irreducible matrix, there may not exist a common n such that R n has all entries strictly 
positive. As an example, for the matrix (?q); the (1, l)-th entry of all odd powers and (1, 2)-th entry of all 
even powers will be zero. Any irreducible matrix has a positive eigenvalue of algebraic multiplicity one, which 
is larger than or equal to all other eigenvalues in modulus. Such an eigenvalue is called the Perron- Frobenius 
eigenvalue of the irreducible matrix. Since no other eigenvalue equals the Perron-Frobcnius eigenvalue, 
which is real and positive, the Perron-Frobcnius eigenvalue is strictly larger than the real part of any other 
eigenvalue. The left and the right eigenvectors corresponding to the Perron-Frobcnius eigenvalue have all 
entries strictly positive. The Perron-Frobenius eigenvalue will be contained in the interval formed by the 
smallest and the largest row sum. The Perron-Frobenius eigenvalue will be in the interior of the interval 
unless the matrix is balan ced. For a dis cussion on the Perron-Frobenius eigenvalues of irreducible matrices, 
we refer to Chapter 1.4 of lSenetal (|2006| ). 

In case the replacement matrix R is irreducible, its Perron-Frobenius eigenvalue will be 1, as it is balanced 
with common row sum 1. Let 7r# be the left eigenvector of R, normalized so that the sum of the coordinates 
is 1, corresponding to the Perron-Frobenius eigenvalue. Then ttr is also the unique stationar y distribution 
satisfying tvrR = 7Zr and will have all coordinates strictly positive. Then (see, for example, iGouetl . 119971 ) 
C n I (N +1) — > ttr almost surely. This strong law for the color counts in the irreducible case has been studied 
in more general setups and further strong/ weak laws, centr al and functi o nal ce ntral limit theorems for linear 
combi nations o f colo r counts are well known. We refer to Bai and Hu ( 19991 ) for the martingale approach 
and to Jansonl ( 2004 ) for the branching process approach; both papers also contain detailed references to the 
literature. 

However, when the replacement matrix is not irreducible or balanced, the balls of different colors may 



i ncreas e a t different rates and strong /weak li mits for C n are not known in full generality. iBose et al 



(|2009al lbT) . Flaiolet et al. ( 20061 ). Jansonl ( 20061 ) and the references in these papers contain some results in 
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these directions which are relevant in this context. The case of upper triangular' R has been studied in these 
papers, sometimes under suitable assumptions. 

Actually some strong laws are also available for more general case of reducible R. F or example, th e case 
of balanced block triangular R with irreducible diagonal blocks have been identified in iGouet (1997) as an 
important class among the reducible ones. The assumption of balanced rows leads to convenient application 
of martingale techniques. More precisely, let us assume that R is balanced and upper block triangular with 
K + 1 blocks, like 

(Qi \ 

o Q 2 



Qk 

o 





\0 ■■■ P J 

where Q 1 , . . . , Q K arc irreducible (but not necessarily balanced) matrices with Perron- Frobcnius eigenvalue 
less than 1 and P is irreducible and obvious l y bala nced with Perron- Frobenius eigenvalue 1. Let ■np satisfy 
ttp = irpP. Then Proposition 4.3 of lGouetl (l997t) says that for such an R, C N /(N + 1) ->• (0, 0, . . . , 0, tt p ) 
almost surely, that is the vectors of color counts corresponding to the first K blocks are killed if scaled by 
N. This raises the question whether the rates of the vectors of color counts corresponding to the first K 
bl ocks can be id entified. 

Janson (l2006h has studied a two color urn model with reducible replacement matrix. He took the matrix 



to be lower triangular, but did not put any further restrictions. The matrix was allowed to have different 
row sums, as well as, possibly negative entries. The asymptotic behavior of the color counts were discussed 
in details using branching process tec hniques. 



The above two urn models inspired iBose et al.l (|2009bl ) to consider the urn model with triangular replace- 
ment matrix and, under some technical assumptions, the rates of individual color counts were identified. It is 
clear that the triangular model, where one deals with blocks of size one, is a special case of block triangular 
models with irreducible diagonal blocks. Section 1.2 of lSeneta sketches an arrangement which reduces 

a matrix with nonnegative entries to a block lower triangular one. By further rearranging the states in a 
reverse order, the matrix can be made into a block upper triangular one. In fact, any balanced replacement 
matrix can be reduced to a block upper triangular one where the diagonal blocks are either irreducible or the 
scalar zero through a rearrangement of the colors. It should be stressed that the result is true for any matrix 
with nonnegative entries and the equality of row sums is not important. The states can be identified with 
colors. Note that any rearrangement of colors is same as a similarity transform by a permutation matrix. 
Here the nonzero irreducible diagonal block need not be balanced. The rearrangement is quite simple in 
nature, but we have not come across any detailed ready reference in the literature. So we quickly outline a 
proof of the rearrangement in the following lemma. 

Lemma 1.2. Any matrix R, with all entries nonnegative, is similar to a block upper triangular matrix, 
whose diagonal blocks are either irreducible or the scalar zero, via a permutation matrix. 

Proof. As already explained, we shall explain the proof through a rearrangement of colors, which is equivalent 
to a similarity transform through a permutation matrix. 

We shall say a color i leads to a color j, if for some n, the (z,j)-th entry of R n is positive. The 
colors i and j are said to communicate if both i leads to j and conversely. The class of i is defined as 
Ci = {] ' '■ i communicates with j}. Note that either Ci is empty or contains i. The colors with empty classes 
will be called lone colors. For two different colors i and j, either their classes coincide or they are disjoint. 
Further note that the submatrices of R corresponding to each nonempty class is irreducible. Next, make 
singleton classes of each lone color. The collection of all distinct classes (including the singleton classes of 
the lone color) forms a partition of the collection of all colors and they will form the required blocks after 
a permutation. A class C is said to lead to another class C if some color in C leads to another color in C 
and we shall write C < C. It is easy to see that is a well-defined, transitive and anti-symmetric relation 
and hence is a partial order on the collection of distinct classes. So the collection of distinct classes can be 
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rearranged in a non-decreasing order. The corresponding rearrangement of colors will have the replacement 
matrix in the required block upper triangular form with zero or irreducible diagonal blocks. The diagonal 
blocks corresponding to nonempty classes of some color will give the irreducible ones, while the lone colors 
will give the scalar zero diagonal blocks. □ 

It should be noted that the eigenvalues together with multiplicities remain unchanged under similarity 
transforms. Also, as the similarity transform is done by a permutation matrix, this will result in the 
eigenvectors being rearranged correspondingly. In this article, without loss of generality, we only consider the 
case of balanced block triangular R with scalar zero or irreducible diagonal blocks. Note that, for irreducible 
replacement matrix, we hav e only one b l ock. A special case of two irreducible diagonal blocks, both of which 
are balanced, was treated in Bose et al. I (|2009ah . The strong law there is given in Proposition 4.2(iii) and the 



proof follows from the proof of Theorem 3.1(iv) of the same article. The proof essentially used the strong law 
for the irreducible case mentioned earlier along with the introduction of a stopping time. However, when the 
irreducible diagonal blocks are not balanced, we require new techniques to handle the strong convergence of 
the vectors of color counts corresponding to the diagonal blocks. This article presents these new techniques 
along with a simplification of earlier proofs using Kronecker's lemma. The limits are identified later in the 
article after a further rearrangement and an extra technical assumption is made. The limits involve suitably 
normalized left and right eigenvectors of the appropriate irreducible diagonal blocks corresponding to their 
Perron-Frobenius eigenvalues. The initial zero diagonal blocks identified after this rearrangement give a 
different type of limits. 

As a consequence of the rearrangement mentioned in Lemma II. 2\ the D x D balanced, block upper 
triangular replacement matrix R with nonnegative entries is assumed to have K + 1 blocks, where the 
diagonal blocks are either irreducible or the scalar zero and none but last of which need to be balanced. 
The fc-th block contains d k many colors with di + ■ ■ ■ + dx+i = D. We shall denote the blocks by Q kl , 
where k, I = 1, 2, . . . , K + 1. Thus, Q kl will be of dimension d k X di and Q kl = 0, whenever k > I. We shall 
generally denote the diagonal block Q kk by Q k . 

Let Xn be the row vector called the incidence vector whose m-th entry will be 1 and all other entries 
0, if m-th color is drawn at the iV-th draw. The subvectors of Cn and Xn corresponding to k-th block of 
colors will be denoted by C$ and x^n respectively. Let Tn denote the er-field generated by the collection 
of random vectors {Xi-i • • • > Xn}- We- have the following evolution equation: 

Cn+i = Cn + Xn+iR- (1-1) 
We shall show that the rates of growth of the color count subvector will be constant in each block and the 
rate for the fc-th block will be of the form N ak \og^ k N. 

Definition 1.3. If the color count subvector corresponding to the fc-th block grows at the rate N ak log^ fc N, 
that is, C$ /(N a » log 13 " N) converges almost surely and in L 2 , then we shall denote the rate by the rate 
pair (a k ,/3 k ). 

The ordering of the rates of growth induces an ordering on the rate pairs, which is the lexicographical 
ordering, that is, the color count subvector of the fc-th block grows at a rate faster than that of the fc'-th 
block if and only if cither a k > ay or a k = ay and fi k > fty . 

One of the goals of this article is to obtain the rate pairs of the count subvectors corresponding to all 
the blocks, which we do in Theorem 13. II The rate pairs depend on the Perron-Frobenius eigenvalues of the 
diagonal block matrices, whenever it is irreducible. This introduces another important notion of this article. 

Definition 1.4. For a square matrix Q with nonnegative entries, which is either irreducible or zero, we 
define its character fi as the Perron-Frobenius eigenvalue, if Q is irreducible, and as 0, if Q = 0. 

For an upper triangular matrix R formed by nonnegative entries with K+l diagonal blocks {Q k }i<k<K+i, 
which are either irreducible or zero matrices, the character of the fc-th block will be denoted by \i k . 

We shall show that the rate pair of the first block (a±, (3i) = (/ii, 0). The rate pairs of the later blocks will 
be defined inductively. The rate pair of the fc-th block will be determined by the (lexicographically) largest 
among the rate pairs (a mi (3 m ) with m = 1, . . . , fc — 1 satisfying Q mk ^ 0. If the largest such pair is denoted 
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by (a, /3), then = max{a, /^} and will be /3, /3 + 1 or according as a is greater than, equal to or less 
than /ifc. This shows the crucial role played by the character in determining the rates. 

In Section [2] we bring in some notations and prove some results which arc useful for obtaining the rates 
of growth of the color counts. Using these results, we prove the rates, as defined above, in Section |3] We 
introduce further notions, the rearrangement to the increasing order and the assumption (|A|) in Section |4] 
Finally, in Section [SJ we identify the limits for the replacement matrix in the increasing order under the extra 
technical assumption ([A"| . Suitably normalized left and right eigenvectors corresponding to the Perron- 
Frobenius eigenvalues of the irreducible diagonal blocks play an important role in identifying the limits. 
Thus, we obtain the rate of the color count subvectors for all urn models with only possible restrictions of 
nonnegativity of the entries and the balanced condition on the matrix. We identify the limits as well, but 
under the extra technical assumption (jAj) . In the process, we identify the very important role played by the 
characters of all the diagonal blocks and suitably normalized left and right eigenvectors of certain irreducible 
diagonal blocks corresponding to their Perron- Frobenius eigenvalues. 

2. Notations and some auxiliary results 

We begin this section by recalling the notion of Jordan canonical form of a matrix. We need to introduce 
the square matrix F for that purpose. The order of the matrix will be clear from the context. The matrix 
F will have all entries zero except the ones in the diagonal just above the main diagonal, namely, 



fij — 



1, ifj = i + l, 
0, otherwise. 



If the order of the matrix is 1, then the corresponding scalar is defined as 0. The matrix F is nilpotent. In 
particular, if F has order d, then F d = 0. Further, for any 1 < i < d, F l has all entries zero except the i-th 
diagonal above the main one, which has all entries one. If v is an eigenvalue of a matrix R, then, define the 
Jordan block corresponding to v as D v = vl + F. We also have a matrix E„ of full column rank, whose 
columns are Jordan vectors corresponding to v. In fact, the first column of H„ is a right eigenvector of R 
corresponding to v and 3„ satisfies Ra u = a u D u . In the Jordan decomposition of R, given by RE, = Da, 
the matrix D is block diagonal with diagonal blocks given by _D„ corresponding to some eigenvalue v. The 
total number of blocks (possibly of different dimensions) , that an eigenvalue v contributes to D equals its 
geometric multiplicity and the sum of the dimensions of the blocks corresponding to v equals its algebraic 
multiplicity. The matrix S is obtained by concatenating the matrices E„ in the corresponding order. 

If z is a non-zero complex number, we denote by T z an upper triangular matrix, which has (i, j)-th entry 
is z~v~ t+1 ' , for j >i. As J 1 is a nilpotent matrix, we have 



1 



E 

i=i 



l -F 

z 



X -F\ ={zI-FY 



z 



Now, if A is a positive number larger than the absolute value of any eigenvalue of a matrix _R, then (XI — R) 
is invertible. If v is an eigenvalue of R with the corresponding Jordan decomposition Ra u = E„_D, y = 
a v {yl + F), then we have (A7 — R)3 U — H„((A — v)I - F) = 3 V T^ V and hence 

E„T X _„ = (XI - R)- 1 ^. (2.1) 

We further use the following notation, defined for all complex numbers z, except for the negative integers, 

jv-i , 

im*)=ii(i+^t 

71=0 V 

which satisfies Euler's formula for the Gamma function, 

IL N (z)~N*/T(z + l). (2.2) 

For a vector £, the vectors |£| 2 and £ 2 will denote the vectors whose entries are squares of the moduli 
and squares of the entries of the vector £ respectively. For two real vectors £ and £ of same dimension, 
inequalities like ^ < C wm correspond to the inequalities for each coordinate. 



(i 



For a complex number z, we shall denote its real and imaginary parts by 'Rz and 3z respectively. 

We are now ready to do the analysis for obtaining the rates of the color counts for each block. The 
presence of diagonal blocks as matrices with possibly complex eigenvalues introduces additional complications 
compared to the triangular case. Also in the block triangular case, it is not wise to study the individual 
color counts directly. We consider the linear combinations of color counts in each block with respect to 
eigenvectors and Jordan vectors. Before obtaining the rates for each color count, we state some auxiliary 
results in this section, which will be useful later in proving the rates. The first result concerns a simple 
observation regarding (possible complex valued) martingales, which follows from two simple applications of 
Kronecker's lemma. 

Lemma 2.1. Let {Mn} be a (possibly complex valued) martingale with the martingale difference sequence 
AMpf = Mpj+i — M/v satisfying E[|AAf/v| 2 ] = O(cat) for some sequence of positive numbers {cat}. If for 
some other sequence of positive numbers {a^}, which diverges to infinity, we have X]^Li ( c «-i/ a n) < °°> 
then M]y/aN — > almost surely, as well as, in L 2 . 

Proof. Observe that E[|AM7v/a w | 2 ] = 0(c^/a 2 N ), which is summable. Thus, ^2^=0 AM n /a n forms an 
L -bounded martingale, which converges almost surely. Then both the real and the imaginary parts of this 
martingale will also converge almost surely. Further, as sjv — * 00, using Kronecker's lemma, both 3?Mjv/ajv 
and QAijv /o-n converge to almost surely. Thus M /a^v — > almost surely. 

Further, since ajv diverges to infinity and {c/v-i/a 2 ^} is summable, we have, again using Kronecker's 

lemma, J2n=i c n-i/a% converges to zero. Further, E[\M N \ 2 ] = + J2n=o E AM n\ 2 } = (j2n=o c ») ■ 
Thus, E[\M N \ 2 ]/a% -> 0. □ 



For the second result, we consider a block upper triangular replacement matrix with three blocks. 
Lemma 2.2. Consider an urn model with the replacement matrix 

(Qi Q12 <?i 3 \ 

R= Q 2 q 23 , (2.3) 
V° 1 / 

which is balanced and has all entries nonnegative, with d\ , di and 1 colors in three blocks respectively. None of 
the submatrices need to be balanced and, except for Q 2 , none of the submatrices need to be irreducible either. 
However, Q 2 is assumed to be irreducible with the Perron- Frobenius eigenvalue /i and the corresponding right 
eigenvector £. Let v be another eigenvalue of Q 2 with Jordan decomposition given by Q 2 ^ v = a v D u . The 
rows of Q 12 are {q^kkcIu some of which may be the zero row vectors. The color count vector and its 
subvectors are denoted as before. 

Also assume that there exists a > fi and an integer f3 > 0, such that, for all I = l,...,di, satisfying 
q l 0, we have, 

's > ui almost surely and in L 2 , (2.4) 

N a \og e N y ' 

where ui is nonnegative, but can be random. Further assume that 

C$C/{N a log^ N) converges almost surely and in L 2 
to a nondegenerate random variable. Then 



r-(2) 

L<Z<( 



N a \os p N 



uiq{a u T a ^ v almost surely and in L 2 . (2-5) 



Proof. Let denote the a- field generated by the collection {xii ■ ■ ■ iXn} as before. The incidence vector 
and its subvector are defined as before. Let £ l5 . . . , £ t be the columns of H, y with t > 1. Define £ = 0. By 



the definition of T\_ Vl it is equivalent to prove that, for i = 1, . . . , t, 



°JV Si 



1 



1 



1 



(a - I/) 



£i I almost surely and in L 2 , 



(2.6) 

which we shall do by induction. 

Now, from the Jordan decomposition, for % = 1, . . . ,t, we have Q 2 £i = + = £■ Further, using the 
evolution equation (jl.ll) . we have 



r V)e _ ^(2) e 

'-'iV Si — ^AT-lSi 



E XN,m$i + x { n€- 



\<l<d! 



From this, we obtain the martingale 



„(2) # N-l 

M N = ^Lii - 



E c -^e t + cl 2) &-i 

l<Z<di 



(2.7) 



J 



having martingale difference 



AM N = 



n 



JV+l 



E 

l</<di 



XN+l,l 



Since, C is a right eigenvector corresponding to the Perron- Frobenius eigenvalue of Q 2 , it has all coordinates 
positive and hence, for some c > 0, we have |£| 2 < c^. Hence, using Euler's formula (|2.2[) and the fact that 

(2) 

at most one of xn+i,i for I = 1, . . . , d\ and Xn+i can be nonzero simultaneously, we have, 



E [|AMat| 2 ] = O ( N 



-(l+29?i/) 



E 



^l^lKchC N .l\ll£i\ 2 



E 



(2) 

Hence, by the assumptions made on the rates of convergence of Cat.; for I = 1, . . . , d\ with q ( ^ 0, and C N £, 
we obtain E[|AA/at| 2 ] = O(log' 3 N /N 1+m »- a ). Next, we apply Lemma O with c N = \ g fj N/N 1+m "- a 
and a N = N a - nu log* 3 N. Since a > [i > and 3?z/ < fi < a, Lemma O applies and M N /{N a - Uv log' 3 AT) 
and hence Mn /(N a ~ 1 ' log* 3 AT) converges to zero almost surely and in L 2 . 

Thus, from Euler's formula (|2.2p and the definition of the martingale Mm in (|2.7[) , we have, 



(n + 1)" log /3 (n + 2) 



lim — ' — = lim 5 — > > ■ 

JV->oo AT" log/ 3 TV JV->oc AT""" log' 3 AT x ^ di ^ n„ +1 (^)r(i/+ 1) (n+ 1)1+"-" (n + l) a logV + 2 ) 



JV-l 



lim 



N- 



=Q n n+1 (i/)r(^ + l) (n + l) 1 +"- a (n+ l) Q log' 3 (n + 2)' 



(n + 1)" log^n + 2) 



W Si-1 



where the limits are both in almost sure and in L 2 sense and we use (|2.4j) in the last step. 

Since a > /i > Jiz/, the first term above simplifies to -^—^^uiq^, where the sum is over all I = 1, . . . , d\, 

such that q l ^ 0. If for some i > 1, limAr^oo C ^ '^i-i/ \N a log* 3 AT) exists almost surely and in L 2 , then 
hm ^_ — = \ mqfc H hm 



JV^oo ]\[a \ Q J3 jy a — V 



l<l<d t 



a — V N^roo J\[a l g/3 J\[ 



almost surely and in L 2 . For i = 1, since £ = 0, we immediately have (|2.6[) . Assuming the induction 



hypothesis for i — 1, (|2.6|) can now easily be extended to i as well. 



□ 



Remark 2.3. If q ; = for all I = 1, . . . , di, the argument of the above proof still goes through with the 
obvious modification that any sum over the indices I = 1, . . . , di such that q l ^ will be zero, and the limit 
in (12.51) will also be zero. 



Finally, we obtain some moment bounds for the color counts in the block upper triangular model, as 
reduced by Lemma 11.21 We first obtain the expectation of the linear combination of the count vector of a 
block. 



Lemma 2.4. Consider an urn model with balanced, block upper triangular replacement matrix R formed of 
nonnegative entries, where the k-th diagonal block Q k is either irreducible or the scalar zero with the character 
fJ-k- If Qk * s irreducible, let Q be a right eigenvector corresponding to the Perron- Frobenius eigenvalue, which 
is also the character, fi k . If Q k is the scalar zero, let £ be the scalar one. Then 

( \ 



E 



c^c =n w ( Mfc ) 



JV-l 



V 



4 fe) c+ E E 

l<m<fc-l n=0 
m:Q mk ^0 



1 



(n + l)n„+i(//fc) 



E 



(2.8) 



/ 



Proof. From the evolution equation we get C$C = cjv-iC + Xn QmkC- Taking conditional 

expectation, we have 

1 



E 



1 



0) 



N I C N 



xc+ E 



l<m<fc-l 



M m ) n * 



(2.9) 



Taking further expectation and iterating, the result follows. □ 

Next, we define a martingale and obtain a bound on the square moments of the martingale difference. 

Lemma 2.5. Consider an urn model with balanced, block upper triangular replacement matrix R formed of 
nonnegative entries, where the k-th diagonal block Q k is either irreducible or the scalar zero with the character 
f-k- IfQk * s irreducible, let Q be a right eigenvector corresponding to the Perron- Frobenius eigenvalue, which 
is also the character, fi k ■ If Qk * s the scalar zero, let £ be the scalar one. Then 

N-l 



M N = 



M k )r 



^ (n + l)n„+i(itfe) 



(2.10) 



rijv(Mfc) 

m:Q mk ^O 

is a martingale and, for the martingale difference AM/v = -Mjv+i — Mjy, we have, for some constant c > 0, 

c 



E [(AM N ) 2 ] < 



(N + l)(Tl N+1 (p k )y 



E E 

l<m<k 
m:Q mk ^O 



M^l 
N 1 



(2.11) 



where Q kk = Q k . When Q k is the scalar zero or equivalently fj,j~ = 0, the above bound (|2.1ip simplifies to 



E [(AM N ) 2 ] < 



(N + l) 



E E 

l<m<fc-l 



M m )l 
N 1 



(2.12) 



Proof. The fact that Mjy is a martingale follows from the expression for the conditional expectation in 
We also have 



AM 



N 



ILv+lX/ifc) 



(fe) 



1 



N+l 



' N 



E 



l<m<fc-l 



(m) 
X-N+l 



1 



N+l 



C 



(m) 
N 



Q, 
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Since Xat+i cannot be nonzero simultaneously for two distinct values of m. taking conditional expectation 
and ignoring the negative terms, we have, 

1 



V[{AM N ) 2 \T, 



N 



< 



(N + l)(U N+1 (f, k )f 



l<m<fc-l 



(2.13) 



Since 1 has all coordinates equal to one, and hence, positive, we have, for some constant c > 0, £ 2 < cl and 
for m = 1, . . . , k — 1 satisfying Q mk ^ 0, (Q rn kC) 2 < &■ Putting these bounds and the fact that /x| < 1 
in (|2.13p and taking expectation, (|2.11[) follows. 

When Q k is the scalar zero or equivalently fi k = 0, then (|2 . 12[) follows from the simple observations that 
IlAr+i(0) = 1 and the first term within the bracket in (|2.13[) is absent. □ 



Remark 2.6. If Q mk = for all m = 1, . . . , k— 1, then the results and the arguments of Lemmas 12.41 and 12.51 
will still go through with obvious modifications. The last sum within the bracket on the right side of (|2.8j) 
and the last term in the definition of the martingale in (|2.10|) will be absent. The sum on the right side 
of (j2~TTj) will reduce to E[C^1]. If further Q k = 0, then = C { Q k) for all N and the martingale defined 
in ([2~10| will be a constant, as /j, k = as well. This will give E[(AMat) 2 ] = in (f2~T2|) . 

3. Rates of color counts 

We are now ready to give an inductive method to obtain the rates of the color count subvectors corre- 
sponding to each block. 

Theorem 3.1. Consider an urn model with a balanced, block upper triangular replacement matrix R formed 
by nonnegative entries and with blocks {Q m i}i< m .i<K+i, where the diagonal blocks Q kk = Q k are either 
the scalar zero or an irreducible matrix, for k = 1, . . . , K + 1. Let the characters of the diagonal blocks be 
{/■tfc}i<fc<i<'+i- The color count vector and its subvectors are defined as before. Then, for k = 1, . . . , K + 1, 
there exists nonnegative real numbers a k and nonnegative integers f3 k , such that (a k , j3 k ) are the rate pairs for 
C$ , that is, / (N ak log^ fc N) converges almost surely, as well as, in L 2 . The pairs {(ak, Pk)}i<k<K+i 
are defined inductively as follows: For k = 1, ol\ = fix and f3\ = 0. Having defined (a±, /3\), . . . , (a k -\, f3k-i), 
let (a, (3) be the (lexicographically) largest rate pair in the set {(a m , f3 m ) : 1 < m < k — 1, Q m k ^ 0}. If the 
set is empty, declare (a, (3) = (— oo,0). Then, we define 

a k = max{a,ft.} 

and 

if n k > a, 
if ,u fc = a, 
if Hk < a. 

Proof. We use induction on the number of blocks k. For the case k = 1, if = 0, then the first color 
count remains constant and hence converges without scaling. If /Lti > 0, then Q 1 is irreducible with Perron- 
Frobcnius eigenvalue \i\ and a corresponding right eigenvector £. Since £ has all coordinates positive, choose 
c > such that £ < c£. It is then easy to see that M' N = C N £/rijv(/xi) is a martingale with the martingale 
difference 




AM' - ^ (r (1) 1 r (1) \ C 

Since < fx x < 1, we get, using Euler's formula ([23]) . E[(AA/^) 2 ] < cE [M' N ] /((N + l)LTjv+i(/ii)) = 
O (jV - ( 1+Al1 )) , which is summable. Hence M' N is an L 2 -bounded martingale, which converges to a nondegen- 

erate random variable almost surely and in L 2 , and thus, by Euler's formula (|2.2|) . C$ C/N^ 1 also converges 
to a nondegenerate random variable Y\ almost surely and in L 2 . 
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Next consider any eigenvalue v of Q 1 other than the Perron- Frobenius one, Let the corresponding 
Jordan decomposition be Qi(£x : ■ • • : £t) = (£1 : ' ' ' : £t)Dv, f° r some t > 1. Note that Qi£i = 4^_i + v^, 
for i = 1, . . . , t, where £ = 0. We define the martingale 

r (iU iv-i r (i)t 

]\ r" — N Si \ " u n Si-1 



W IS (n+l)Hn+iM 

as in the proof of Lemma 12.21 and arguing similarly, we get E[(AMJJ) 2 ] = 0{N- < ~ 1+mi "^). Then, again 
applying Lemma [2~T1 with cjv = A r_ ( 1+2K ' y ~' il ) and a^v = A rMl_Kl/ and arguing as in the proof of Lemma l2.2[ 
we have M^/iV 1- " — > almost surely and in L 2 . Again, simplifying using Euler's formula (|2.2[) . we have, 

lim J_ C «£ = hm 1 V + 1 C "^-i 

at-s-ooA^i w 1 w^oo A>i-" ^ n n+ i(i/)r(i/ + 1) (n + ( n + l)w ' 

where the limits are both in almost sure and in L 2 sense. As £ = 0, the limit is zero for i = 1 and then 
inductively, it can be shown that the limits are zero for alH = 1, . . . , t. This gives C^a^/N^ 1 — > almost 
surely and in L 2 . Finally, consider RS = H.D, the Jordan decomposition of R, where 4" is the first column 
of S. Then C^a/N^ 1 -> Fi(l, 0, . . . , 0) and hence 

C^/N" 1 — ^ Yj 7r almost surely and in L 2 , (3.1) 

where 7r is the first row of H _1 and is a left eigenvector (normalized so that tt£ = 1) of Q 1 corresponding 
to the Perron- Frobenius eigenvalue of Q 1 . Hence tt has all coordinates positive. This shows the rate pair 
(ai,/?i) = (^i,0) - (/ix,Ki)- This technique of handling nonzero characters will be repeated for the later 
blocks as well. For a block with a nonzero character, which is then the Perron-Frobcnius eigenvalue of 
the corresponding irreducible diagonal block, we first find out the rate of the linear combination of the 
corresponding count subvector with respect to a right eigenvector corresponding to the Perron-Frobenius 
eigenvalue. The limit will be a nondegenerate random variable, which will be a function of previous such 
random variables, unless the block is the leading block of its cluster with the order of the corresponding 
leading character zero. We then obtain the limits of the linear combinations corresponding to the Jordan 
vectors as well with the same rate and combine them to get the final result for the count subvector. 

Assume that the rate pairs have been obtained for the first k — 1 blocks. We define (a, /3) and (a k ,f3 k ) 
as in the statement of the theorem and show that (a k ,8 k ) is the required rate pair for the fc-th block. If 

(k) (k) 

a = — co, then Q rnk = for all m < k. If we further have fi k = 0, that is, Q k = 0, then C N = C for all 
A and the rate pair will be (ak, 8 k ) = (0, 0) as required. So assume either a ^ — oo or fi k ^ 0. Equivalently 
we have 

Qmk 7^ for some m = 1, . . . , k. (3.2) 
First consider the case fj, k = 0, that is, Q k is the scalar zero. Hence, from (|3.2j) . we have Q mk ^ for 
some m = 1, ...,k — 1. Then the set {(a m ,8 m ) : 1 < m < k — 1, Q mk ^ 0} is nonempty and a k is a 
nonncgative real and 8 k is a nonncgative integer. Define the martingale Mjv as in Lemma 12.51 with £ as the 
scalar one, since ji k = 0. Then using (|2.12p and the choice of (a,j3), we have 



E [(AMjv) 2 ] = O (n-^ 1 -^ log' 3 n) . (3.3) 



Then we apply Lemma O with c N = A^ 1 "") log* 3 A and a N = N ak log^ fc N. Since fi k = and a is 
nonnegative, we have only two possibilities, a > \i k = and a = ji k = 0. Observe that 

— , if a = u k = 0, or equivalently, a k = and 8 k = 8 + 1, 

A log^ A 
1 

j, — , if a > itfe = 0, or equivalently, a k — a and B k = B 

N 1+a XogP A 

and thus ^ n {cn-i/ a? N ) < co. So, from Lemma T2.ll we have MN/(N ak log^ k N) — > almost surely and in 
L 2 . Simplifying using Euler's formula (|2.2|) . the definition of the martingale, the choice of (a,/3) and the 
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facts that £ is the scalar one and N ak log TV — » oo, we have 



lim 

Af->oo /\T Qfc log TV 



1 



m<~k- 
m:Q mk ^O 



lim 



" Q 



/3 + lJV^ooiog^iV 

Km<fc — 1 ° 



A: * 



if a 



Y - lim 



,(m) 
'JV 



(3.4) 



, a/v^oo7V Q log p iV 

l<m<fc — 1 & 



if a > /i fc = 0, 



where the limits are almost sure, as well as, in L 2 . Also, all the limits are nonnegative and as (a,/?) is the 
largest rate pair, at least one of them is nondcgenerate. So the limit above is nondegenerate and we have the 
rate pair (at, fik) as suggested in the statement of the theorem. The limit in (|3.4[) will be denoted by Y k . 

Next consider the case fik > 0. Then Q k is irreducible with the Perron- Frobcnius eigenvalue /j,k- Choose 
( as a right eigenvector of Q k corresponding to fi k - Since £ has all coordinates positive, choose c > 0, such 
that 1 < cC 



If a = — oo, that is, Q mk = for all m = 1, . . . , k — 1, we shall apply Lemmas 
Remark 12.61 in mind. In this case ctk = Hk and /?& = 0. From Lemma [2.41 we have E 



Defining the martingale Mm as in Lemma [2.51 we have E[(AMat) 2 ] = 0(TV 



-(l+Aifc) 



and 



/V S 



keeping 
0(A^ fc ). 



), which is summable. 



Thus, M N and hence, by Eulcr's formula 427J), C^C/N^ = C ( ^C/{N ak log 13 " TV) converges almost surely 
and in L 2 to nondegenerate limits and the limit of the second sequence will be denoted as Y k . 

Finally consider the possibility that a ^ -oo and jik > 0. Then a is a nonnegative real and f3 is a 
nonnegative integer. From Lemma |2.4[ we have, 



E 



1 



ILv(Atfc) 



N-l 



E 



y, logV + 2) (n + l)^ E 



^ (n + l) 1+ ^- Q U n+1 (a k ) 

l<m<k-l n=0 y ' n+L\t"K) 



CrT^QmkC 



(n + l) a log^i + 2) 



By the choice of (a, the expectations in the sum of the right side above are bounded. Hence, using Euler's 
formula (12.21). we have 



E 



N L 



< cE 



Observe that the rate pair (a k , 
the highest rate, giving, 



fO(TV»), if{*k>a, 
I 0(TV» \og p+1 TV), if fx k = a, 
[o(N a log^N), if /i fc < a 

= 0(N a " log Pk TV). 
£ ) is lexicographically larger than or equal to (a, /3) and hence (a k , fik) gives 



E 

l<m<fe 
m:Q mk ^O 



E 



/-f( m )l 
N 1 



= O ( N ak log?" TV 



Then define the martingale Mm as in Lemma [2751 and we have from p. lip . 

E [{AM N ) 2 ] = O [jy-( 1 + 2 '"" a ') log' 3 ' 1 TV 



We then apply Lemma IQ with c N = N- (1+2 ^ k - ak hog' k N and a N = TV Qfc ~' Jfc log TV. Observe that 
cn-i/o-n ~ 7V~( 1+Qfc ) log - ^ fc TV. Now a k = max{a,^fc} > fi k > and hence J^n^n-i/o-n) < 00 ■ So, again 
from Lemma [2.11 we have M^/(N ak ~ tlk log /3fc TV) — > almost surely and in L 2 . Further simplifying using 
Eulcr's formula (|2.2p , the definition of the martingale and the choice of (a, (3), we have 



lim 



TV 
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- i im 1 y WVjJ) (n + 1)^ Cj m) Q mfc C (35) 

jva fc - Pfc jv ^ 4i (^ + i) 1+Mfc " Q n Il+ i(^ fe )r(/i fc + i)( n + i)"iog' 3 (n + 2)' 

where the limits are almost sure, as well as, in L 2 . Again, all the limits are nonnegative and as (a,/3) is 
the largest rate pair, at least one of them is nondegenerate. So the limit above is nondegenerate and will 
be denoted by Y k . If £tfc < a. = oc k and u m denotes the almost sure and L 2 limit of /{N a log' 3 N) for 
m = 1, . . . , k — 1 with Q mk 7^ 0, then the limit in ()3.5j) can be further simplified to 

r im TT^TTTZ = H u m Q m kC= V] u m Q mk (a k I -Qk^C (3-6) 



W ^oo _/v Q fc log Pfe N ce k - /J, k 



l<m<fe-l l<m<fc-l 



Thus, C^C/C^log^AT) converges to a nondegenerate limit Y k both almost surely and in L 2 and for 
yUfc < a, the limit is given by the right side of p.6[) . 

Next consider an eigenvalue v of Q fc other than the Perron-Frobenius eigenvalue with the corresponding 
Jordan decomposition Q k S u = S U D U . Then club all the colors after the fc-th block into a single one and 
make the first k — 1 blocks into one group and the fc-th block into another. This gives us the replacement 
matrix in the form (|2 . 3[) . Also, by the choice of (a, (3), (|2.4[) holds with the rate pair (a, f3) and hence 
(a k ,(3 k ). (Note that is a possible limit in fiTfy.) We also have that C { ^C/(N ak log /3fc N) converges to a 
nondegenerate random variable Y k almost everywhere, as well as in L 2 . Thus, by Lemma 12.21 we have 

C (fc) H 

— — 7T > > u/q;H, y r a ._^ almost surely and in L 2 , (3.7) 

° l<l<di-\ h«fc-i 

Lq^O 

where ui is the almost sure and L 2 limit of C n.i/ (N ak \og^ k N) for any index I allowed in the sum. If 
q = — oo, that is, q l = for all I = 1, . . . , d\ + ■ ■ ■ + d k -\, then, by Remark |2.3[ the limit in (|3.7jl still holds 
with the interpretation that the limit is zero. 

If A*fe > ol (this includes the case a = — oo), then observe that the rate pair (a k ,/3 k ) gives a higher rate 
than (a, (3) and thus the limits u m in (|3.7j) arc all zero, which gives C^a v /(N ak log' 3 ' 1 N) —> almost 
surely and in L 2 . If fi k < a, then [i k < a — a k , then from (|2.1[) . we have S„T at _„ = (a k I — Qf.)" 1 ^. 
Also, observe that, by the induction hypothesis, the rates are same within a block. Thus, if any index I is 
included in the sum on the right side of (|3.7j) . we can include any other index /' in the same block with 
q v = 0, as C n,i' / (N ak log' 3 ' 1 N) will also converge to uv almost surely and in L 2 , but will not contribute 
anything extra. Further, for the m-th block, the limit vector u m in (|3.6[) consists of such ui's only. So we 
can rewrite (|3.7p as 



lim 



C (fc) H 

J™ Mr* f ~K „ = Yl U mQ m k( a kI - Q fc ) _1 H„. 

l<m<fc— 1 

Finally, consider Q fc H = 3D, the Jordan decomposition of Q k , where the first column of H is £. Then, 
we have 

c p s fY fc (i,o,...,o), if^>«, 

N->oo ]Va k \ Qe: Pk AT ~ ) Z)l<m<fc-1 u mQ mk (a k I - Q fc ) -1 E, if /Xfc < a. 
B I rn:Q mkl L0 

Observing, as in the case fc = 1, that H _1 has the first row as 7r, a left eigenvector (normalized so that 
7r£ = 1) of Q k corresponding to the Perron-Frobenius eigenvalue, which has all coordinates positive, we 
conclude that 

c {k) f y ^' if>fc>a, 

lim = { V u m Q mk (a k I -Qk)- 1 , if \i k < a. (3.8) 
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This shows that (ak,Pk) is the rate pair for the fc-th block and completes the induction step. □ 

4. Rearrangement to the increasing order 

To identify the limits when the color counts are scaled as in Theorem 13. 1[ we need to first rearrange the 
colors further and reduce the replacement matrix to the increasing form (see Definition 14. 3|) and make a 
technical a s sumpti on ([A"]) . The rearrangement to the increasing order is an extension of Proposition 2.4 of 
Bose et al. Bef ore goi ng into the rearrangement, we need to introduce some notions in analogy to 



Section 2 of iBose et all (|2009bl ). 



Note that, in Lemma 11.21 we have required the zero diagonal blocks to be scalar. However, we do 
not impose any such condition here. We shall require zero diagonal blocks of higher dimensions for the 
rearrangement to the increasing order in Lemma 14.41 Also, if Q is irreducible, then the character fj, is its 
Perron-Frobenius eigenvalue, and hence all its eigenvalues are smaller than or equal to fi in modulus. If 
Q = 0, then all its eigenvalues are zero. Thus, in either case, all the eigenvalues of Q is smaller than or 
equal to its character in modulus. 

Definition 4.1. For a block upper triangular matrix R formed by nonnegative entries with K + 1 characters 
{fa}i<k<K+i, let 1 < ii < %2 < ■ ■ ■ < ij < ij+i < K + 1 be the indices of the running maxima of the 
characters, that is, fa = fa x < fa 2 < ••■ < faj < fa J+1 and for ij < k < ij+i with j = 1,..., J or 

i 



< k < K + 1 with j = J + 1, we have fa. < fa. . 



Since the replacement matrix R is assumed to be balanced, we necessarily have Qk+i is balanced and 
Hk+i = 1- Also, the row sums of all other diagonal blocks are less than or equal to one and hence fa < 1 
for k = 1, . . . , K. So we necessarily have ij+i = K + 1. 

Definition 4.2. In a balanced block upper triangular matrix R formed by the nonnegative entries with 
characters {^k}i<k<K+i and their indices of running maxima {ij}i<j<j+i, the blocks indexed by ij,ij + 
1, . . . , ij + i — 1 form the j-th cluster for j = 1, . . . , J and the ij+i-th block alone forms the ( J + l)-th cluster. 
For j = 1,...,J + 1, the ij-th block is called the leading block of the j-th cluster. 

We shall define the leading character as Aj = fa. for j = 1, . . . , J+l and the order of the leading character 
as, for j = 1, . . . , J + 1, 

= < j ■ Xj' = Xj} = #{fc < j ■ lik = fa, }, (4.1) 
which counts the number of earlier occurrences of the character of a leading block. 

The concepts of clusters an d the leading block s are to be viewed in comparison to the notions of the 
blocks and the leading colors in lBose et al.l ( 2009rJ ). Since the characters are nonnegative, if Xj = for some 



j = 1, . . . , J+ 1, then we must have Ai = ■ ■ ■ = Xj = 0, i\ = 1, . . . , ij = j and Ki = 0, . . . , Kj = j — 1. Thus, 
if there are zero diagonal blocks at the beginning, all of them will form clusters of size one and these are the 
only leading zero diagonal blocks. 

Any balanced block upper triangular matrix Ji, formed by nonnegative entries and reduced to the form 
where all diagonal blocks are either irreducible matrices or the scalars zero, can be further reduced to a form 
which we describe next. 

Definition 4.3. A balanced block upper triangular matrix R, formed by nonnegative entries and blocks 
{Qki}i<k,i<K+i-, which arc either irreducible or zero matrices, with indices of running maxima of characters 
{ij}j=i and leading characters {Aj}^^ 1 , is said to be in the increasing order if 

(i) All non-leading zero diagonal blocks are scalar. 

(ii) For index k of any non-leading block, that is, ij < k < i(j+\) with j = 1, 2, . . . , J, we have 

fc-i 

m—ij 

(iii) If Xj = and Kj > for some j = 2, . . . , J, then each column of the submatrix Q i ._ l ^. must be 
nonzero. 
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The condition (JTTJ) holds for any non- leading block. In fact, the condition (JTTJ) in the above definition implies 
that at least one entry of the submatrices Q m ^ for m = ij, . . . , k—l to be nonzero. However, the condition (pH|) 
extends the requirement to the leading blocks as well, when the leading character is zero and has a positive 
order. Further, in this case, we not only have the submatrices as nonzero, we indeed have each of the columns 
of the submatrices as nonzero. Note that the condition ffTTTI) in the above definition is vacuous if Ai > 0. 



It was shown in Proposition 2.4 of iBose et al. I (l2009bh that any balanced upper triangular matrix can be 



reduced to another block upper triangular matrix satisfying the condition ([n} of Definition 14 . 31 by a similarity 
transform using permutation matrices. As in Section [1] the similarity transform using a permutation matrix 
will be viewed as a rearrangement of the states, will not change the eigenvalues with their multiplicities and 
will rearrange any eigenvector accordingly. We extend that rearrangement in the following result. 

Lemma 4.4. Any balanced block triangular matrix R, with all entries nonnegative and diagonal blocks either 
an irreducible matrix or the scalar zero, is similar to a matrix in increasing order via a permutation matrix. 



Proof. As in the proof of Lemma 11.21 we shall describe the similarity transform by a permutation matrix 
through a rearrangement of the states. We do it in two steps. In the first step, we obtain a matri x satisfying 



conditi on ((n) in Definition 14.31 alone. The rearrangement is very similar to Proposition 2.4 of IBose et al 



(]2009bl ). where we replace the diagonal entries by the characters of the blocks, the leading colors by the 
leading blocks and the blocks by the clusters. We do not repeat the proof here. By an abuse of notation, we 
shall use the same set of notations for the rearranged matrix. Note that all the zero diagonal blocks remain 
scalar after this rearrangement. 

If the first diagonal block is nonzero and hence all the leading characters are nonzero, the condition (|iiT|) 
in Definition 14. 31 becomes vacuously true and the proof is complete. Thus, without loss of generality, assume 
that the first M(> 0) diagonal states are zero. They are the only leading blocks, which are zero. In the 
second step, we shall rearrange the colors in these M states to satisfy the condition (|TTT|) in Definition 14.31 
Thus the condition (JTTJ) in Definition 14.31 will remain unaffected. Also none of the non- leading zero diagonal 
blocks will be affected and they will remain scalar satisfying the condition £[J in Definition 14.31 Note that 
this second step of rearrangement may coalesce some of the initial zero diagonal states and hence the overall 
number of blocks may reduce. We shall proceed by induction. The m-th step will produce a zero diagonal 
block (not necessarily scalar), which is also a cluster, with the (leading) character zero and order m — 1. We 
shall show that after m-th induction step with m > 1, the rearranged matrix is block upper triangular, the 
first m blocks, and thus clusters, have {dk}i<k<m states and satisfy the condition jm} in Definition 14.31 and 
for the remaining M — (d\ + ■ ■ ■ + d m ) states, the columns have at least one entry corresponding to the blocks 
after the first m — 1 ones, that is, at least one entry with index more than di + • — H d m -i, as nonzero. 

Observe that since Ai =0, the first column must be the zero vector. We first bring all states (which 
includes the first state), whose columns are zero vectors, to the front and declare that they constitute the 
first block, as well as the cluster. The order of the states within the block is not important. Note that 
this rearrangement maintains the block upper triangular structure. The condition on the remaining states 
among the first M ones also holds, since all zero columns have been collected. Again, by abuse of notations, 
we shall use the same set of notations for the matrix thus rearranged. If the size of the first block d\ = M, 
we are done. Otherwise, assume that we have obtained m > 1 blocks of sizes {dk}i<k<m, which, except the 
first one, satisfy the condition ([m| in Definition 14.31 and for the remaining M — (d± + ■ ■ ■ + d m ) states, the 
columns have at least one of the entries, indexed more than d\ + - ■ • + d m -±, as nonzero. Also, the rearranged 

matrix is block upper triangular. As before, by an abuse, we retain the notations. If d± H H d rn = M, we 

are done. 

Otherwise, we consider the remaining M — (di + ■ • • + d rn ) states among the first M ones. The columns 
corresponding to all these states have at least one entry with index more than d\ +• • ■ + e? m _i as nonzero, by 

the induction hypothesis. Thus, for any column having all entries with index more than di H h d m as zero, 

one of the entries indexed d\ + - ■ ■+d m -i + 1 through di + ■ ■ - + d rn must be nonzero. The (di + ■ ■ - + d m + l)-th 
column satisfies this condition and thus the set of the states satisfying this condition is nonempty. We collect 
all the states satisfying this condition, that is, with the corresponding columns having entries with index 
more than d\ H h d m as zero and bring them forward, after the m-th block, ahead of the rest, to form the 
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(m+l)-th block, as well as the cluster. The order of the states within the block is again not important. Since 
the columns have all entries with index more than d\ + . . . + d m zero, the block upper triangular structure is 
retained. Also, after rearrangement, this block satisfies the condition (jnl|) in Dcfinition l4.3[ as, corresponding 
to each state, the column has at least one entry corresponding to m-th block, indexed d± + • ■ • + d m —i + 1 
through di + ■ ■ ■ + d m , as nonzero. Further, since we have collected all the states with the corresponding 
columns having entries with index more than d\ + • • • + d m as zero, the remaining states, if any, should have 
at least one of the entries with indices more than d\ + • • • + d m as nonzero. This completes the induction 
step. □ 



Thus, for the rest of this article, we shall, without loss of generality, assume that the balanced replacement 
matrix R with all entries nonnegative has diagonal blocks zero or irreducible and is in the increasing order. 



Remark 4.5. The arguments in the proof of Theorem 13.11 can be repeated when the replacement matrix is 
in the increasing order and it will be possible to identify the rate pairs more directly for the replacement 
matrices in the increasing order. Note that the arguments in the proof of Theorem 13.11 assumed that Q k 
is the scalar zero, whenever = 0, whereas the increasing order allows some of the leading zero diagonal 
blocks to be of higher dimension. However, we can break the leading zero diagonal blocks into the blocks of 
single colors and obtain the rate pairs separately. It is then easy to see that, if the fc-th block is in the j-th 
cluster, that is, ij < k < ij + i for some j = 1, . . . , J or k = ij for j = J + 1, then atk becomes the leading 
character of the cluster Xj. Further, if the leading character of the cluster A,, or its order Kj is zero, then ftk 
is the order of the leading character of the cluster, Kj. It is not possible to identify (3k in such a simple form, 
if both Xj and Kj are positive and we need to make the further assumption (fA|) , which we are going to make 
in the next paragraph, to complete the identification. We obtain the complete identification of the rates and 
the limits in Theorem 15.31 under the assumption ([A]). Yet, it would be important to note that much of the 
identification of the rate pairs for the replacement matrix in the increasing order in simple closed form is 
possible even without the assumption (|A"|). 



To prove Theorem 15.31 as in Bose et all ( 2009b ). we need to extend the condition (p} of Definition 



to the leading block of the (j + l)-th cluster, if the order of the leading character of the cluster is positive, 
that is Kj+i > 0, or equivalently Xj = Xj+i. In particular, we make the following assumption on a balanced, 
block upper triangular replacement matrix R in the increasing order, formed by nonnegative entries, with 
blocks {Q m i}i<m,l<K+i, indices of the running maxima of the characters {ij}i<j<J+i, the leading characters 
{Aj}i<j<j + i and their orders {k,}i<j<./+i: 

(A) Whenever Xj > and Kj > 0, we have Em=^_ x Qmi 3 + °- 

This extension may not be possible in general. As a counterexample, consider the following upper triangular 
replacement matrix 



R 



Note that we do not make the assumption (|A| when Xj = 0, as, by Lemma [4~4l this extension is possible if 
the character is repeated. 

To reiterate, we shall assume, for the rest of the article, that the balanced replacement matrix R, with all 
entries nonnegative, has diagonal blocks zero or irreducible and is in the increasing order and further that the 
assumption (|AJ holds. The assumption is made for the leading block of the j-th cluster for j = 1, . . . , J + 1, 
whenever the leading character of the cluster is positive and the order of that leading character is also 
positive. Only fAJ has to be assumed, while the rest of the form can be obtained as a reduction from a 
general balanced replacement matrix with nonnegative entries using Lemmas 11.21 and 14.41 



0.5 
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For ease of understanding, we present below the j-th cluster, as a typical one, containing blocks with 
indices + 1, . . . , ij+i — 1 (note that the block with index ij+i actually goes to the next cluster): 

(Qij Qij.ij + l '" Qij.k '" Qij,i j + 1 -l \ 

o Qij+i ••• Qij+i,k '" Qij+i,i J+1 —i 



Qk ■■■ Q 



k,i j+1 - 



V o o Qi j+1 -i / 

The characters Xj = fi^, fi/., Xj+i = of the diagonal blocks Qi,QkiQi +1 respectively, satisfy (if. < 

< Aj+i, for ij < k < The index Kj counts number of times Xj has occurred as a character before 

ij-th diagonal block. 

Note that all the blocks have Perron- Frobenius eigenvalue less than or equal to 1. As observed earlier, the 
last block is balanced with row sum 1 and has the Perron-Frobenius eigenvalue, and thus the character, 1 and 
hence forms the last cluster. If possible, suppose some earlier block has the character, and thus the Perron- 
Frobenius eigenvalue, 1, then it should also be balanced with row sum 1. Thus it will be a leading block 
and all other blocks in the same row will be zero submatriccs. Hence, by the condition (JTT|) of Definition 14.31 
the immediately succeeding diagonal block cannot have the character less than 1. So the next block will 
also have the character 1 and will be a leading block and now the assumption ([A} will be violated for two 
successive leading blocks with the same leading character. Thus, for a balanced block triangular matrix with 
all entries nonnegative, which is in the increasing order and satisfies the assumption (fA)) . except for the last 
block, no other block will have the character, and thus the Perron-Frobenius eigenvalue, 1. Also, the last 
block will form the last cluster in itself. 

When Q k is irreducible, the left and right eigenvectors of Q k corresponding to the Perron-Frobenius 
eigenvalue \ik will be denoted as 7r' fc ) and C , which arc normalized so that tt^I = 1 = n^Q k \ Then, 
7r( fe ' and tf k ' have all entries positive. 

We now describe the main result to be presented in Theorem 15.31 Recall that the clusters with zero as 
the leading character are formed by a single block and are at the very beginning and the cluster with one 
as the leading character is the last one, that is, (J + l)-th one and is formed by the last, that is, (K + l)-th 
block. If the leading character of the j-th cluster, Xj = 0, then 



1 „( 4j ) ^ 



lo - Bj n N ~* "I ® 12 ® 23 ' ' ' Qij-hv almost surel y and in L 



If ij = 1, the continued product of the matrices above is interpreted as the identity matrix and as 
is assumed to be nonzero, by the condition (fi7T|) of Definition 14.31 we have the limit as a nonzero constant 
vector for all the clusters, if any, with zero leading character. For the last cluster, which contains only the 
(K+l)-th block, the scale is N and the limit random vector is -k^ k+1 \ In the j-th cluster, with the leading 
character Xj G (0, 1), corresponding to the leading block, we have a non-degenerate random variable Vj such 
that 

— ; t: C\, -> V-jTT^^ almost surely and in L 2 . 

N x i log" 3 N N J 

Recall that, since the leading character Xj is nonzero, the submatrix Q i . is nonzero and irreducible and has 
the Perron-Frobenius eigenvalue Xj and the corresponding left eigenvector 7f( ij ' normalized so that the sum 
of the entries is one. For other blocks in the j-th cluster, we use the same scaling and the limit random vector 
is again constant vector multiple of Vj, where the constant vector is obtained by multiplying 7P l " on right by 
a constant matrix. Further, if Kj > 0, then Vj is a constant non-zero multiple of Vj-\. The matrix and the 
scalar multiples have been defined in (|5.1[) and (|5.2[) respectively. Thus, within a cluster, the scale remains 
same. Further, in the clusters where the leading characters are same, the scales change by powers of log N, 
but the limiting random vectors continue to be constant vector multiples of one scalar random variable. The 
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random variable is degenerate, if the leading character is zero or one. Thus, the number of random variables 
involved in the limit equals the numb er of distinc t leadin g characters Xj in the open interval (0, 1). 

In the triangular case discussed in iBose et al. (l2009bh . the scaled count of the leading color of a block 
converged to a random variable. In the block triangular case, we analogously consider the scaled color count 
subvector corresponding to the leading block of a cluster. Here the limiting vector still has one dimensional 
randomness, as it is a constant vector multiple of a scalar valued random variable. Further, in the triangular 
case, the scaled count subvector for a block converged to a vector which is a constant vector multiple of the 
limit random variable corresponding to the leading color. Analogously, the scaled count vector for a cluster 
in the block triangular case converges to a vector which is a constant matrix multiple of the limit vector 
corresponding to the leading block. Moreover, in the triangular case, if the diagonal entries corresponding 
to two successive leading colors are same, then the corresponding limiting random variables are multiples of 
each other. However, in the block triangular case, the limit vectors corresponding to two successive leading 
blocks with the same Pcrron-Frobcnius eigenvalues are not scalar or matrix multiples of each other. Yet, the 
scalar random variables associated with the limit vectors are multiples of each other. 



5. Identification of the limits 

For the purpose of this section, the replacement matrix R has nonnegative entries, is balanced, block 
upper triangular, in the increasing order and satisfies the assumption ([X]). The notations for the blocks, the 
characters, the leading characters and their orders, the eigenvalues and the eigenvectors remain the same. 

To identify the limits, we need to define a sequence of matrices {W k\k=i corresponding to the blocks and 
another sequence of constants corresponding to the clusters. Actually, these matrices and constants 

are useful only when the corresponding characters and leading characters are positive, but we define them 
in all the cases. We define them inductively. We first define the matrices WVs. For the definition of {Wfc}, 
we only require the replacement matrix R to be in the increasing order but we do not need to assume (|A]). 
as follows: 

(i) If k corresponds to a leading block, that is, k — ij for some j = 1, . . . , J + 1 (this includes the cases 
k = 1 and k = K + 1), define W \ = I, the identity matrix of order dk, where, recall that dk is the 
number of colors in the fc-th block. 

(ii) If k corresponds to a non- leading block, that is, ij < k < i, J+ i for some j = 1, . . . , J, define 

fc-i 

W k = ]T W m Q m k (A,/ - Qk)' 1 , (5T) 

m—ij 

a matrix of order di j x dk ■ 

Note that, for ij < k < ij+i, fik, the character, and hence the Perron- Frobcnius eigenvalue, of Q k satisfies 
/it < Xj. Hence the absolute values of all the eigenvalues of Q k , which are smaller than or equal to [ik, are 
strictly smaller than Xj, making (Xjl — Q k ) invertible. Further, 



(Xjl-Q^-^l- 
a j 

where the sum on the right side converges. Observe that all the matrices in the summation on the right 
side have all entries nonnegative. Further, if /i^ > 0, or equivalently, Q k is irreducible, for each element 
of the matrix on the left side, some power of Q k has the corresponding element strictly positive. Thus, 
(Xjl — Qk)^ 1 has all elements strictly positive, whenever (Xk > 0. If /ifc = 0, or equivalently, Q k is the scalar 
zero, then (Xjl — Q^ 1 = 1/Xj is a finite positive number too, as Xj > 0. 
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The constants Wj's are denned, when the replacement matrix R is in the increasing order and satisfies 
the assumption ([X]). as follows: 



if Xj — or Kj = 0, 
:7r (*i-0 W,„Q, ni C ' • otherwise. 



Note that if Kj > and Xj > 0, then Xj = Xj-i > as well. Thus, Q i _ : and are both irreducible and 

it is meaningful to define the left and the right eigenvectors 7r^' _1 ^ and respectively corresponding to 
the respective Perron- Frobenius eigenvalues Aj_i and Xj. 

Next proposition shows that right multiplication of a vector with all coordinates positive by W k keeps all 
coordinates of the resultant vector positive. This is important to show that the limit random vector obtained 
by scaling the count vectors have all coordinates non-degenerate. 

Proposition 5.1. Let it be a vector with all coordinates strictly positive and the replacement matrix R be 
in the increasing order. Then, for all 1 < k < K + 1, the vector TrW k has all coordinates strictly positive. 

Proof. The proof is done through induction. For k = 1 = i±, we have W\ = I and hence ttWi = tz has all 
coordinates strictly positive. Then, assume nW m > for all m < k. We consider two cases of k separately. 

For k = ij for some j = 1, . . . , J + 1, by definition ~W %, = I and TzWi j = tt has all coordinates strictly 
positive. 

Next consider k such that ij < k < ij + i for some j = 1, . . . , J. Then, by (|5.1[) . 

fe-i 

nW k = Y, TvW m Q mk (Xjl - Qk)' 1 . 

m—ij 

By induction hypothesis, for all ij < m < k, irW m have all coordinates strictly positive. Next, we consider 
two subcases separately according as fi^ is zero or positive. 

First, we assume yLtfc = 0. Since we are considering a no n- leading block, the diagonal block must be the 
scalar zero. Then nWk = XJ 1 X)m=i n W m Q mk , where Q mk are d m -dimensional column vectors. Since, 
nW m have all coordinates positive, for all ij < m < k, and by the condition (JnJ in Definition 14.31 at least 
one of the column vectors Q mk with ij < m < k must be nonzero, we must have TtWk is a nonzero scalar. 

Next, we assume Q k is irreducible and then we have observed that (Xjl — Qfc) 1 nas au elements strictly 
positive. Also, by the condition fn} of Definition 14.31 we have, for some ij < m < k, Q mk must have at 
least one element strictly positive. Thus, for that to, TtW m Q mk (XjI — Q^)" 1 will have all coordinates 
strictly positive. All other summands on the right side have all coordinates nonncgativc. Thus irW k has all 
coordinates positive. 

This completes the induction step. □ 

We next show that the constants Wj J s are positive. This will show that for a cluster with the Perron- 
Frobcnius eigenvalue of the leading block same as that of a previous cluster, the limit random vector obtained 
from the scaled color counts is non-degenerate. 

Corollary 5.2. Let the replacement matrix R be in the increasing order and satisfy the assumption (|A"|) . 
Then, for all 1 < j < J + 1, we have Wj > 0. 

Proof. If Kj = or Xj =0, then Wj = 1 and the result holds. Thus, without loss of generality, we can assume 
Kj > and Xj > 0. Since 7r^ i_1 ^ is a left Perron- Frobenius eigenvector of an irreducible matrix Qi j _ l , it 
has all coordinates positive. So, by Proposition 15.11 for all < m < ij, 7r^ -1 'W TO has all coordinates 
positive. Since C^ 1 ^ is the right Perron- Frobenius eigenvector of an irreducible matrix Q t ., it again has all 
coordinates positive. Since Kj > 0, by the assumption (|A"]l . we have, for some ij-i < m < ij, Q mi . must have 

at least one element strictly positive. Thus, for that to, 7r^' _1 ^ W m Q m i X > 0. Also, for ij-\ < m < ij, 
Q mi . have all elements nonnegative. Hence, Wj > 0. 

This completes the induction step. □ 
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Now, wc are ready to identify the limits. 

Theorem 5.3. Consider an urn model with a balanced, block upper triangular replacement matrix R, formed 
by nonnegative entries, having K + 1 blocks, which is in the increasing order with J + 1 clusters having the 
leading characters {\j}x<j<j+i and their orders {'Sj}i< i j<j'+i- We further assume that R satisfies the 
assumption (|A"]l . Then the color count subvector corresponding to the k-th block, for k = 1, . . . , K , satisfying 
ij < k < ij+i, for some j = 1, . . . , J , we have, 



N x i log Kj N 



ij-i 

Y\. Qm,m+li */Aj = 
3 m— 1 

VjTT^Wk, if Xj () 



^ ^ K J m=1 



almost surely and in L 2 , where Vj is a nondegenerate random variable for j < J. For Ai = 0, the continued 
product in the limit above is interpreted as I . 

Furthermore, for the random variables Vj, j = 1, . . . , J, if Kj > 0, we also have 

Vj=w j V j - l . (5.3) 

Finally, for the last count subvector we have 

— C^ +1 ^ — > tt^ k+1 ^ almost surely and in L? . 



Proof. Note that the result for the (K + l)-th block is in iGouetl (|l997t ). The rest we prove by induction on 



k. Much of the argument has already been completed during the proof of Theorem 13.11 We shall now use 
the special structure of the replacement matrix in the increasing order and the assumption (J7Q) to identify 
the limits. The rate pair (ct,/3) will mean same as in Theorem 13. II 



For k = 1, we are in the leading block of the first cluster. If Ai = /.ti = 0, then clearly = and 
we have the required limit. For Ai = fi\ > 0, we use the argument given in the proof of Theorem 13.11 and 
by choosing £ = as the normalized right eigenvector, we obtain from (|3.1|) . C]^ /N^ 1 —> ViTt^ almost 
surely and in L 2 , for the nondegenerate random variable V\ =Y\, as required. 

Next, we assume that the result holds for all blocks till (k — l)-th block and we study the k-th block. 
Wc first identify the rate pairs as obtained in Theorem 13. II using the fact that the replacement matrix is in 
the increasing order and the assumption (|A"| has been made. Recall that an intermediate rate pair (a, /?) 
was defined as the lexicographically largest one in the set {(a m ,f3 m ) : 1 < m < k — l,Q mk ^ 0}. Then, 
we obtained otk — max{a,/Jt} and fik equaled 0, /3 + 1 or j3 according as fi^ is larger than, equal to or 
smaller than a. We consider three cases separately, namely, fc-th block is the leading one of its cluster with 
the corresponding order in the first case, positive in the second case and the block is a nonleading one of 
its cluster in the third case. In the first case k = ij for some j = 1, . . . , J + 1 and Kj = 0. Thus, for all 
I < m < k — 1, we have fi m < fik and hence for all j' = 1, . . . , j — 1, we have \ji < So, by the induction 
hypothesis, for all m = 1, . . . , k — 1, (a m ,f3 m ) are, and as a consequence, (a, (3) is lexicographically strictly 
smaller than (//£, 0). This gives a < and /3k) = (/ife, 0) = (Aj, Kj). In the second case k = ij for some 
j = 2, . . . , J and Kj > 0. (Note that Ki = and the last (J + l)-th cluster is the only cluster with the leading 
character 1 and hence kj+i = 0.) Also fi^ = Xj = \j~i and Kj-i + 1 = Kj in this case. If fik = Xj = 0, 
then using the condition (|mT) of Definition 14.31 and, if fik = ^j > 0, then using the assumption wc 
have Q mi . 7^ for some m = . . . ,ij — 1. Then, using the induction hypothesis, the (lexicographically) 
largest rate pair (a,f3) is attained at such a value of m and (a,/3) = (Aj_i,Kj_!) = (Xj,Kj — 1). Hence 
q = fik and (a^, fik) = (Aj, For the third case, ij < k < ij+\ for some j = 1, . . . , J. By the condition ([n]) 
of Definition 14.31 we have Q rn k ^ for some m = ij, . . . , k — 1. Then, using the induction hypothesis, the 
(lexicographically) largest rate pair (a,/3) is attained at such a value of m and (a,/3) = (Xj, Kj). Since the 
fc-th block is nonleading, we have pLk < Aj and hence a > jik and (a/c,/?fe) = (Aj, Kj). Thus, considering all 
the three cases, we have that the rate for the fc-th block, which is in the j-th cluster, is (ak,(3k) = (^j, K j)- 
Also the three cases that a is less than, equal to or greater than fik are equivalent to the cases that the fc-th 
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block is the leading block of its cluster with the order of the leading character positive, the same with the 
order of the leading character zero or the fc-th block is a nonleading block of its cluster respectively. 

Next, we identify the limits by simplifying the results obtained during the proof of Theorem 13 . 1 1 using the 
fact that the replacement matrix is in the increasing order and the assumption (fA|) has been made. First 
observe that the situation that a k — — oo and /z& = require that Q mk = for all m = 1, . . . , k and hence 
for all m, as the matrix is block upper triangular. However such colors have been included in the first block 
by the construction in the proof of Lemma 14.41 and this situation does not occur for fc > 1. So we can 
assume (|3.2[) that Q m f. ^ for some m = 1, . . . , k. 

First consider the case fik = 0. We shall assume that the fc-th block is in the j-th cluster, for some 
j = 1, . . . , J. As in the limit in ([3.4)1 . we have two subcases, namely, a = /i^ = and a > fik — 0. Recall 
that the subcase a = fj,k = is equivalent to the fact that the fc-th block is the leading block of the j-th 
cluster with the order of the leading character being positive. Thus the leading character is and the k-th 
block is actually the k-th initial cluster with zero character and then Kk = k — 1 > 0. Also, using the 
induction hypothesis and the condition ([111)) in Definition 14.31 only m = k — 1 contributes to the limit in ([3.4)1 
and it simplifies to 



|Cq ^ Y\_ Qm.m+lQk-l,k — 777^0 ' IT Q 



l(jfe-2)l u 11 Kk \ 



m,m+l " 



= 1 



The subcase a > fj, k — is equivalent to the fact that the block is a non-leading block of the j-th cluster 
and, by the condition ([!]) of Definition 14.31 contains a single color. Also the diagonal block is the scalar zero, 
making Xjl — Q k the scalar A_,-. Further, by the induction hypothesis and the condition fnj of Definition ^. 31 
only m = ij , . . . , k — 1 contributes to the limit in p.4[) . Note that some of the corresponding Q mk may 
be the zero matrix, but the corresponding extra terms will not affect the limit. So the limit simplifies to, 
using (15.1)1 . 

k-i 

-VjlZ^ W ^Qrnk = W,iA,l - Q k ) = V^W k . 

^ rn—ij ^ 

Finally consider the case Hk > 0. We identify the limit for the blocks with positive character from (|3.8[) . 
We shall consider three subcases /j,k > ex, fXk < ol and \ik = a. The subcase fik > a is equivalent to the fact 
that the fc-th block is the leading block of the j-th cluster for some j = 1, . . . , J + 1 with Kj — 0. Then, using 
£ _ £0j) anc j hence 7r = 7r^ j ) in the argument of the proof of Theorcm l3.ll we have the limit in the required 
form, where we declare Vj = Y ij and use the fact that Wi ] = I. The second subcase fik < cms equivalent 
to the fact that the fc-th block is a nonleading block of its cluster. Also, by the induction hypothesis, the 
limit vectors u m in (j3.8j) will be nonzero only for m = ij, . . . , k — 1. If some m = ij, . . . ,k — 1 has Q mk = 0, 
they still can be included in the sum in p.8p . as they all contribute zero vectors. Then, by the induction 
hypothesis, the fact that otk = Xj and (|5.1[) . the limit becomes 

fe-i 

VjTv^ W m Q mk (XjI - Q,)- 1 =Vjiz^W k . 

m—ij 

At the end, we consider the subcase fik = a, which is equivalent to the fact that the fc-th block is the leading 
block of its cluster with the order of the leading character being positive. Thus, we have fc = ij for some 
j = 1, . . . , J and Kj > 0. As in the subcase ^k > ot, by considering £ = C}- 1 ^ and hence 7r = 7r^), together 
with the fact that W i- = I and denoting V 3 ■ = Yi . — Yfe, we have, from (j3.8[) . the limit as Vjiz^'W^. So, 
to complete the proof, we only need to check ()5.3p . which is done by simplifying ()3.5)) . Observe that for the 
subcase Hk = a, we have a = cik = fik = Xj and /3k = ft + 1 = Kj = Kj— l + 1. Then, by the assumption ([A]) 
and the induction hypothesis, only the terms corresponding to m = ij-i, . . . ,k — 1 will contribute to the 
limit in (|3.5j) . Also, the terms corresponding to m = ij-i, . . . , fc — 1 with Q mk = can be included in the 
sum in the limit, as they do not contribute anything extra. Thus, recalling the facts that C = C an d 
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k = ij and using (|5.2[) . the limit in (|3.5[) simplifies to 



n = ^ = -^-itt^- 1 ) ^ w-,„g„„,c 




and proves (|5.3[) . 



□ 
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